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CONCATENATION OF CONTAINERS IN SYNCHRONOUS DIGITAL 
HIERARCHY NETWORK 

Field of the Invention 

5 The present invention relates to containers in a synchronous digital network, 

and particularly, although not exclusively, to a synchronous digital hierarchy 
(SDH) network or a synchronous optical network (SONET). 

Background to the Invention 

10 Historically, the telecommunications industry has developed separately and 

largely independently from the computing industry. Conventional 
telecommunications systems are characterized by having high reliability circuit 
switched networks for communicating over long distances, whereas data 
communications between communicating computers is largely based upon 

15 shared access packet communications. 

Datacoms may operate over a local area, to form a local area network 
(LAN) or over a wide area to form a wide area network (WAN). Historically the 
difference between a LAN and a WAN is one of geographical coverage. A LAN 
2 0 may cover communicating computing devices distributed over an area of 
kilometers or tens of kilometers, whereas a WAN may encompass 
communicating computing devices distributed over a wider geographical area, of 
the order of hundreds of kilometers or greater. 

2 5 However, the historical distinction between local area networks and wide 

area networks is becoming increasingly blurred. 

Conventional local area networks are generally taken to be digital data 
networks operating at rates in excess of 1 MBits/s over distances of from a few 

3 0 meters up to several kilometers. Conventional local area networks are almost 
universallv^serial-Svstems.-in-which_both,data^and_control functions are carried 

through the same channel or medium. Local area networks are primarily data 
transmission systems intended to link computer devices and associated devices 
within a restricted geographical area. However, many local area networks 
3 5 include speech transmission as a service. A plurality of computer and associated 
devices linked together in a LAN may range from anything from a full-scale 
mainframe computing system to a collection of small personal computers. Since 
a local area network is confined to a restricted geographical area, it is possible to 
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employ vastly different transmission methods from those commonly used in 
telecommunications systems. Local area networks are usually specific to a 
particular organization which owns them and can be completely independent of 
the constraints imposed by public telephone authorities, the ITU, and other public 
5 services. Local area networks are characterized by comprising inexpensive line 
driving equipment rather than the relatively complex modems needed for public 
analog networks. High data transmission rates are achieved by utilizing the 
advantages of short distance. 

io On the other hand, conventional wide area networks operate in general on 

a greater scale than local area networks. A wide area network is generally 
. employed whenever information in electronic form on cables leaves a site, even 
for short distances. Wide area networks are generally carried over public 
telecommunications networks. 

15 

Because conventional telecoms systems have developed in parallel with 
conventional datacoms systems, there is a significant mis-match in data rates 
between conventional datacoms protocols as used in LANs and WANs, and 
conventional telecoms protocols. In general, telecoms operators provide 
20 equipment having standard telecoms interfaces, for example E1, T1, E3, T3, 
STM-1 , which are used by the datacoms industry to provide wide area network 
point to point links. However, this is inconvenient for datacoms providers since 
datacoms protocols have developed using a completely different set of interfaces 
and protocols, for example carrier sense multiple access collision detection 

2 5 CSMA/CD systems, subject of IEEE standard 802.3, and Ethernet which is 

available in 10 MBits/s, 100 MBits/s and 1 GigaBits/s versions. Conventional 
datacoms protocols do not match up very well to conventional telecoms 
interfaces, for example E1 , E3, T1 , STM-1 data rates, because of a mis-match in 
data rates and technologies between conventional datacoms and conventional 

3 o telecoms. 



In order to provide transport of OSI layer 2 datacoms traffic cover a wide 
area in an efficient manner, the inventors have previously disclosed transport of 
OSI layer 2 data frames over synchronous digital hierarchy networks (including 
3 5 SONET). 

In the applicant's co-pending US patent application entitled "Frame Based 
Data Transmission over Synchronous Digital Hierarchy Network", a copy of which 
is filed herewith, there is disclosed a method of carrying OSI layer 2 frame based 
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data, for example IEEE standard 802.3 carrier sense multiple access/collision 
detection (CSMA/CD) local area network packets, Ethernet packets, conventional 
token ring packets, conventional token bus packets, and fiber distributed data 
interface (FDDI) packets directly over a synchronous digital network. Such 
5 disclosed system may provide OSI layer 2 switching functionality such as was 
previously available in prior art local area networks, but extended over a wider 
geographical coverage area which has been historically considered to have been 
provided only by prior art wide area networks. 

10 In the applicant's co-pending US patent application entitled "payload 

Mapping in Synchronous Networks", a copy of which is filed herewith, there is 
disclosed a method and apparatus for containment of OSI layer 2 frame based 
data into a set of synchronous digital hierarchy (SDH) virtual containers, by rate 
adapting a plurality of OSI layer 2 data frames by invoking buffering and flow 

15 control in a rate adaption means, and mapping the rate adapted OSI 2 data 
frames directly into a plurality of SDH virtual containers. This process enables a 
virtual OSI 2 local area network to be constructed across a wide area network 
supported by a synchronous digital transport layer. 

20 Since data rates used by conventional OSI layer 2 datacoms systems are 

either higher than data rates of individual virtual containers in SDH systems or fit 
inefficiently into available faster virtual containers, there is the problem of how to 
carry higher bit rate OSI layer 2 datacoms traffic in SDH virtual containers, to 
achieve the result of an OSI layer 2 channel carried over an SDH network. 

25 

Summary of the Invention 

An object of the present invention is to provide a synchronous digital 
container system within the confines of ITU-T recommendation G.70X which 
provides high efficiency and minimum delay for transport of frame based data 

3 0 packets directly over a synchronous digital network without further encapsulation 

in intermedi ate pr otocol la yers. 



A further object of the present invention is to provide an SDH frame 
structure suitable for transmitting and receiving frame based data in a manner 
3 5 which overcomes variations in delay between different paths across a 
synchronous network. 

Specific implementations of the present invention aim to provide a method 
and apparatus for virtual concatenation of VC-3s, and VC-12s in a form which is 
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suitable for carrying frame based data. In this specification, the term "virtual 
concatenation" is used where the underlying network is unaware of any special 
relationship between the virtual containers which make up a group of virtually 
concatenated virtual containers. Particularly, although not exclusively, such 
5 frame based data may comprise OS I layer 2 data frames. 

According to one aspect of the present invention there is provided a method 
of transporting data over a synchronous digital network, said method comprising 
the steps of: generating in parallel a plurality of synchronous virtual containers, 

10 each at a lower bit rate than a bit rate of said data, each said virtual container 
having a payload section; associating said plurality of virtual containers with each 
other by means of assigning association data describing said association into 
said plurality of virtual containers; inputting said transported data into said 
payloads of said plurality of virtual containers; and outputting said plurality of 

15 associated virtual containers onto a synchronous digital network. 

Preferably said plurality of associated virtual containers are output onto said 
synchronous digital network substantially in parallel. Said step of associating 
said plurality of virtual containers with each other preferably comprises inserting 
20 said association data into a plurality of payloads of said plurality of virtual 
containers, said association data permitting recovery of the original association at 
a destination end. Preferably said step of inputting said transported data into 
said plurality of virtual containers comprises byte interleaving bytes of a frame of 
said transported data between said plurality of payloads. Preferably said plurality 

2 5 of virtual containers are generated as a plurality of streams of virtual containers 

and said step of associating said plurality of virtual containers with each other 
comprises associating a plurality of said streams of virtual containers with each 
other. 

3 0 Preferably said step of associating said plurality of virtual containers 

together by means of assigning association data comprises adding a stream of 
identification data to each said virtual container, said steam identification data 
identifying which of said plurality of streams said virtual container belongs to. The 
method preferably comprises including a sequence identification data to 
3 5 individual ones of said plurality of virtual containers, said sequence identification 
data designating a sequence in which said individual virtual containers are 
generated with respect to each other. Suitably the sequence identification data 
comprising a cyclically repeating code data. In the best mode, there is assigned 
to individual ones of said plurality of virtual containers a cyclically repeating code 
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sequence having a repetition period of at least 2 N+1, where N is the number of 
sequentially received virtual container payloads in a single stream. 

Alternatively, said step of associating said plurality of virtual containers 
5 together by means of assigning association data comprises utilizing a path trace 
byte in a virtual container overhead as a stream identifier data for identifying a 
virtual container as belonging to a particular said virtual container stream. 
Instead of including sequence identification data in the virtual container payload, 
said sequence identification data may be carried within a K3 byte of an overhead 
10 section of said virtual container. A sequence identification code data may extend 
over a plurality of said virtual containers of a said steam, for identifying a position 
of each said virtual container comprising said virtual container stream. 

The invention includes an apparatus for incorporating data input at a first 
15 data rate into a plurality of streams of synchronous digital hierarchy virtual 
containers each output at a second data rate, said apparatus comprising: means 
for continuously generating a plurality of virtual containers in parallel; means for 
generating data describing an association of said plurality of virtual containers, 
and for assigning said association data to said plurality of associated virtual 
20 containers; and means for inserting said first data rate data into said plurality of 
payloads of said plurality of virtual containers. 

According to a second aspect of the present invention there is provided a 
method of recovering data from a plurality of synchronous virtual containers, said 

2 5 method comprising the steps of: receiving said plurality of virtual containers; 

identifying an association data from said plurality of virtual containers, said 
association data indicating an association between individual ones of said 
plurality of virtual containers; reading data bytes from each payload of said 
plurality of associated virtual containers; and re-assembling said data from said 

3 0 plurality of read payload data bytes. 



Preferably said process of reading said data payloads comprises reading a 
plurality of said payloads in a byte interleaved manner. Preferably said step of 
identifying an association data from each of said plurality of virtual containers 
3 5 comprises reading a plurality of stream identification data from said plurality of 
virtual containers, said stream identification data designating which of a plurality 
of streams of virtual containers said virtual containers belong to. Preferably said 
step of identifying an association data between said plurality of virtual containers 
comprises reading a plurality of sequence identification data designating where in 
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a sequence of virtual containers each individual virtual container belongs. A 
plurality of separate streams of associated virtual containers may be received 
simultaneously. Said step of reading data bytes from each payload of said 
plurality of associated virtual containers may comprise reading said data bytes 
5 substantially in parallel from a plurality of virtual containers of a same sequence 
identification from a plurality of associated virtual container streams. Where the 
association data are not carried in a virtual container payload section, said step of 
identifying an association data from said plurality of virtual containers may 
comprise inspecting a path trace byte of each of a plurality of said virtual 
io containers, and distinguishing from which of a set of said stream of virtual 
containers said individual virtual containers belong, from said read path trace 
data bytes. A sequence identification data designating where in a stream of said 
virtual containers, a said virtual container belongs, may be read from a K3 byte of 
a said virtual container. 

15 

The invention includes a method of recovering data carried in payloads of a 
plurality of associated synchronous digital hierarchy virtual containers, said 
method comprising the steps of: for each said virtual container: reading data 
indicating an association between said virtual container and other ones of said 
20 plurality of virtual containers; allocating a memory storage area for storing a 
payload of said virtual container; inputting said virtual container payload into said 
memory area; and reading said data from said memory area in parallel with data 
read from other said memory areas corresponding to payloads of other said 
virtual containers of said plurality of virtual containers. 

25 

Said step of, for each virtual container, reading data in parallel with data of 
other virtual containers may comprise: for each said memory area, setting a read 
pointer to a memory location of said memory area; wherein said plurality of read 
pointers are set to said memory locations such that successive bytes of said data 
3 0 frame are read from said plurality of memory locations in sequence. A said data 

frame ma y be as sem bled from sa id parallel read da ta. A said da ta frame 

comprises an OSI layer 2 data frame. The invention includes a method of 
recovering a data block carried in a plurality of payloads of a plurality of 
associated synchronous digital hierarchy virtual containers, said method 
3 5 comprising steps of: receiving a plurality of streams of said plurality of associated 
virtual containers; for each said received virtual container stream allocating a 
corresponding respective memory area for storage of data payloads of virtual 
containers of said stream; storing said plurality of virtual container payloads in 
said corresponding allocated memory areas; and reading individual bytes of said 
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plurality of stored virtual container data payloads in sequence to reconstruct said 
data block. 

Preferably said step of reading individual bytes of said plurality of payloads 
comprises: for each said memory area, setting a read pointer to a memory 
location corresponding to a next data byte of said data block to be read, 
contained within that data payload; and reading said data byte once a preceding 
data byte of said data block has been read from a memory location of another 
said memory area. Said bytes are preferably read from each of a plurality of said 
memory areas in which said virtual container payloads are stored. 

The invention includes apparatus for recovering data from a plurality of 
synchronous digital hierarchy virtual containers containing said data, said means 
comprising: a random access memory configured into a plurality of individual 
memory areas allocated for storage of payloads of said plurality of virtual 
containers; a data processor means operating to identify an association data of 
said virtual containers, said association data indicating an association of said 
plurality of virtual containers; and means for generating a plurality of read pointers 
operating to successively read a plurality of memory locations of said memory 
areas for recovering said data from said plurality of virtual containers. 

Brief Description of the Drawings 

For a better understanding of the invention and to show how the same may 
be carried into effect, there will now be described by way of example only, 
specific embodiments, methods and processes according to the present 
invention with reference to the accompanying drawings in which: 

Fig. 1 illustrates schematically a prior art synchronous digital hierarchy 
STM-N frame; 

Fig. 2 illustrates schematically the prior art SDH multiplexing hierarchy; 

Fig. 3 illustrates schematically details of a regenerator section overhead, a 
multiplex section o verhead, and a pl urality of administrative unit (AU) pointers 
comprising a header of the STM-N frame of Fig. 1 herein; 

Fig. 4 illustrates schematically a section of a synchronous network over 
which is carried an OSI layer 2 datacoms channel between first and second 
computing devices; 

Fig. 5 illustrates schematically a protocol stack for carrying an OSI layer 2 
data channel over a synchronous digital network; 

Fig. 6 illustrates schematically an OSI layer 2 port card for interfacing 
between OSI layer 2 apparatus and synchronous digital network elements; 
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Fig. 7 illustrates schematically a differential delay problem which may occur 
with a plurality of virtual containers transmitted over a synchronous digital 
network between source and destination nodes by a plurality of different routes; 

Fig. 8 illustrates schematically a plurality of virtual containers which are 
5 virtually concatenated with each other to form an effective container for an OSI 
layer 2 data frame payload; 

Fig. 9 illustrates schematically components of an OSI layer 2 port as 
illustrated in Fig. 6 herein, operating to fill a plurality of virtually concatenated 
virtual containers, each virtual container being of a lower bit rate, with a higher bit 
10 rate OSI layer 2 data frame; 

Fig. 10 illustrates schematically how an OSI layer 2 data frame of a higher 
bit rate is carried in a plurality of virtually concatenated virtual containers by byte 
interleaving the OSI layer 2 data frame between payloads of the virtual 
containers; 

15 Fig. 11 illustrates schematically process steps of a transmit process carried 

out by the port apparatus of Fig. 6; 

Fig. 12 illustrates schematically how a pair of virtual containers may arrive 

with a differential delay at a destination port apparatus, the pair of virtual 

containers arriving in a first order; 
20 Fig. 13 illustrates schematically how a pair of virtual containers may arrive 

with a differential delay at a destination port apparatus, the pair of virtual 

containers arriving in a second order; 

Figs. 14 to 17 illustrate schematically how a pair of virtual containers arriving 

at a destination port apparatus with a differential delay are processed for 

2 5 recovery of an OSI layer 2 data frame from the payloads of the pair of virtual 

containers; 

Fig. 18 illustrates schematically a process for receiving a plurality of 
associated virtual containers comprising a virtual concatenation of virtual 
containers at a destination port; 

3 0 Fig. 19 illustrates schematically a process for extraction and re-assembly of 

an OSI layer 2 data frame from the payloads of a plurality of received associated 
virtual containers comprising a virtual concatenation of virtual containers; and 

Fig. 20 illustrates schematically components of an OSI layer 2 port for 
receiving virtual containers and recovering OSI layer 2 data frames from a 
3 5 plurality of virtually concatenated virtual containers 



Detailed Description of the Best Mode for Carrying Out the Invention 

There will now be described by way of example the best mode 
contemplated by the inventors for carrying out the invention. In the following 
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description numerous specific details are set forth in order to provide a thorough 
understanding of the present invention. It will be apparent however, to one 
skilled in the art, that the present invention may be practiced without limitation to 
these specific details. In other instances, well known methods and structures 
5 have not been described in detail so as not to unnecessarily obscure the present 
invention. 

In the following description there is used an example of a stream of OSI 
layer 2 data frames being transported over a plurality of streams of virtual 

10 containers as an example of the payload carried by a plurality of virtual 
concatenated virtual containers. However, it will be understood by a person 
skilled in the art that any data payload can be carried by a plurality of virtually 
concatenated virtual containers, and the advantages of the invention are most 
apparent for a data payload which has a data rate which is too fast to be carried 

15 in a nearest data rate virtual container (eg data 5% or more faster than a nearest 
equivalent virtual container data rate under ITU-T recommendation G.707), but 
which inefficiently fills a next higher up data rate virtual container (eg the data rate 
of the transported data is 30% or more slower than the higher data rate of the 
next available virtual container in which it could be carried). 

20 

Referring to Fig. 1 herein, there is illustrated schematically a prior art 
synchronous digital hierarchy (SDH) synchronous transfer mode frame. The 
STM frame has a duration of 125 jxs, and comprises a string of serially 
transmitted data bytes, which can be drawn schematically in two dimensions as a 

2 5 (270 x N) column x 9 row byte array as shown in Fig. 1 herein. Within the basic 

STM-N frame structure, a first 9 columns of the frame comprise a "section 
overhead" area 100, and the remaining 261 columns comprise payload area 101, 
in which data is carried. The STM-N frame forms the basis of the SDH 
multiplexing scheme as specified in ITU-T recommendation G.70X, which 

3 0 incorporates a set of different multiplexed data rates in the range 1 .544 MBits/s to 

622 Mbits/s a nd above, the lower bit rates being multi plexed to hi gher bit rates 
according to the SDH hierarchy as shown schematically in Fig. 2 herein, as is 
well-known to those skilled in the art. In this specification, references to 
synchronous digital hierarchy multiplexing includes the synchronous optical 
3 5 network (SONET) options, as will be understood by those skilled in the art, and 
SONET options may be referred to in parentheses after description of SDH 
features. 
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At each level of the SDH multiplex hierarchy, data is carried in the STM-N 
payload section 101 of the STM-N frame. For example, the basic transmission 
rate defined in the SDH standards for an STM-1 frame is 155.520 MBits/s. The 
STM-1 frame consists of 2,430 8 bit bytes which corresponds to a frame duration 
5 of 125 [is. Three higher bit rates are also defined: 622.08 MBits/s (STM-4), 
2488.32 MBits/s (STM-1 6) and 9,953.28 MBits/s (STM-64). The higher bit rates 
are achieved by interleaving on a byte by byte basis a number N of the basic 
STM-1 frames. 



10 The 2,430 byte payload section of an STM-1 frame, carries a plurality of 

virtual containers (VCs). Each virtual container comprises a plurality of data 
bytes divided into a path overhead component and a payload component 
Various types of virtual container are defined in ITU-T recommendation G.70X, 
including VC-1, VC-2, VC-3, VC-4, VC-12. For VC-1 and VC-2, the path 

15 overhead bits comprise bits which are used for error performance monitoring and 
network integrity checking. 

A VC-3 comprises an 85 byte column x 9 row byte structure. For the VC-3 
container, the path overhead component is located in a first column of the 9 row x 

20 85 column structure and includes bytes which verify a VC-3 path connection; a 
byte which provides bit error monitoring, a signal label byte indicating a 
composition of the VC-3 payload; a path status byte allowing the status of a 
received signal to be returned to a transmitting end; a plurality of path user 
channel bytes to provide a user specified communication channel; a position 

2 5 indicator byte for providing a generalized position indicator for payloads; an 
automatic protection switching byte; a national operator byte which is allocated 
for specific management purposes such as tandem connection maintenance; and 
a plurality of spare bytes. 



3 0 A VC-4 container comprises a 261 byte column x 9 byte row structure, 

having,similaLpath^oV-erhead^bvteJunctions as for a VC-3 container as des cribed 

above. 



A plurality of virtual containers are incorporated into an STM-1 frame as 
3 5 follows. Firstly, the virtual container is positioned in a tributary unit (TU), or an 
administrative unit (AU) with a pointer indicating the start of the virtual container 
relative to the tributary unit or administrative unit as appropriate. VC-1s and VC- 
2s are always positioned in tributary units, whereas VC-4s are always positioned 
in an AU4 administrative unit. Tributary units and administrative units are each 
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bundlecl into their respective groups: tributary unit groups (TUGs) for tributary 
units, and administrative unit groups (AUGs) for administrative units. Tributary 
unit groups are multiplexed into higher order virtual containers which in turn are 
positioned in administrative units with a pointer indicating the start of the virtual 
5 container relative to the administrative unit. Administrative unit pointers indicate 
the position of the administrative units in relation to the STM-1 frame, and form 
part of the section overhead area of the frame. 

Referring to Fig. 3 herein, there is illustrated schematically in more detail the 
10 9 byte column x 9 row STM-1 section overhead of an STM-1 frame, showing the 
position at which AU pointers for the VCs which comprises the payload of the 
STM-1 frame are positioned within the STM-1 frame. 

A system for sending and recovering frame data over an SDH network 
15 according to the best mode implementation of the present invention will now be 
described. 

Referring to Fig. 4 herein, there is illustrated schematically a section of a 
synchronous digital hierarchy (SDH) network comprising: an STM-fiber ring 400 
20 connecting a plurality of add-drop multiplexers 401-403, each multiplexer having 
a plurality of telecoms tributaries 404, for example E1 tributaries operating at 2 
MBits/s; first and second multiplexers 401, 402 respectively at first and second 
locations A, B, each comprise a corresponding respective first or second OSI 
layer 2 datacoms port card 405, 406; first and second datacoms routers 407, 408 

2 5 connected to said respective first and second datacoms port cards 405, 406 of 

the first and second multiplexers; and communicating with the datacoms routers, 
a plurality of computing devices, for example personal computers, mini 
computers etc, 409, 410. 

3 0 The embodiment of Fig. 4 herein illustrates schematically an OSI layer 2 
dat acoms channel carried over a synchro nou s digital hierarchy ITU-T 

recommendation G.701 type network between first and second locations A, B. 
First and second datacoms routers and first and second synchronous 
multiplexers may be located at, for example, a pair of geographically separated 
3 5 customer premises, thereby providing an OSI layer 2 data channel over a 
relatively wide area. The implementation of Fig. 4 may provide a functionality 
equivalent to what has historically in the prior art been regarded as local area 
network, ie OSI layer 2 datacoms system data rates and reliability, but over a 
geographical area which has historically been considered to be provided by a 
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wide area network, ie over a range of from the order of a few kilometers to 
thousands of kilometers. 

Datacoms frame based data is incorporated into synchronous virtual 
5 containers by the datacoms port cards of the synchronous multiplexers. The 
datacoms port cards are not restricted to inclusion in add-drop multiplexers, but 
may be incorporated in any synchronous digital multiplexer, for example an SDH 
terminal multiplexer. 

10 Referring to Fig. 5 herein, there is illustrated schematically protocol stacks 

operating within the computing devices 409, 410, first and second datacoms 
routers 407, 408, first and second datacoms port cards 405, 406 and first and 
second multiplexers 401 , 402 at first and second locations A, B. Internet protocol 
packets in Internet protocol layer 500 are entered into OSI layer 2 datacoms data 

15 frames in OSI layer 2 protocol 501, as is conventionally known in the art. OSI 
layer 2 datacoms carried IP packets are incorporated into SDH virtual containers 
in SDH protocol layer 502 at the port cards, and are carried across SDH channel 
503. De-layering of the virtual containers occurs by traversing the protocol stacks 
in an opposite direction. 

20 

By incorporating OSI later 2 data frames directly into synchronous digital 
hierarchy ITU-T recommendation G.701 channels, the high data rates available 
using OSI layer 2 frames can be provided in a geographically widespread 
system, which is unlimited by the conventional distance limitations imposed on 

2 5 prior art local area network systems. 

However, there exists the practical problem of how to incorporate and 
extract OSI layer 2 data frames, which are generated at a first set of bit rates with 
SDH virtual containers which are defined to operate at a second set of bit rates. 

3 0 Table 1 herein illustrates a comparison of Ethernet data rates (in a left column of 
Table 1 ) a s an example of OSI layer 2 data rates, wit h nea rest available SDH 

virtual container rates (in the central column of Table 1), and how the Ethernet 
data rates can be accommodated in a plurality of SDH virtual containers (in the 
right column of table 1 ). In general, the Ethernet data rates are at higher bit rates 
3 5 than the nearest available bit rate virtual containers. However, the prior art 
Ethernet data rates are well matched to integer multiples of the synchronous 
digital hierarchy virtual container payload data rates, as illustrated in Table 1. 
The SDH payload data rates have a granularity of a minimum incremental step of 
- 2 MBits/s. A minimum granularity of Ethernet rates is 10 MBits/s, and so 5 
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SDH VC-12 containers each of 2 MBits/s can accommodate neatly a single 10 
MBits/s Ethernet channel. Similarly, a 100 MBits/s Ethernet data rate can be 
accommodated in 2 VC-3 containers, each of approximately 50 MBits/s. 



Table 1 



Ethernet 


Virtual Containers 


Multiple Virtual Containers 


10 MBits/s 


VC-12 (~2 MBits/s) 


1-5 x VC-12 (2 MBits/s - 10 MBits/s) 


10 MBits/s 


VT 


1-8 x VT 1-5 (2MBits/s - 10 MBits/s 


100 MBits/s 


VC-3 (-50 MBits/s) 


1-2 x VC-3 (50 MBits/s - 100 MBits/s) 


100 MBits/s 


STS-1 


1-2 x STS-1 (50 MBits/s - 100 MBits/s) 


1Gbits/s 


VC-4 (-155 MBits/s) 


N x VC-4(155 MBits/s -1.2 GBits/s) 




VC-4 -4c (622 MBits/s) 


N = 1-8 


1 GBits/s 




N x STS-1 (155 MBits/s -1.2 GBits/s) 






N = 3, 6, 9, 12, 15, 18, 21,24 



Referring to Fig. 6 herein, there is illustrated schematically components of 
an OSI layer 2 datacoms port card comprising a synchronous digital multiplexer. 
The datacoms port card is incorporated into a synchronous digital hierarchy 
multiplexer (or a SONET multiplexer), so that as well as having a plurality of 
tributary interfaces for telecoms channels, for example E1, T1, STM-1, the 
multiplexer also has an interface for frame based data systems, as illustrated in 
Fig. 6 herein. 

The datacoms port card of Fig. 6 herein comprises a conventional OSI layer 
2 datacoms physical port 603, the datacoms physical port communicating with a 
router ot a datacoms OSI layer 2 frame switch 602 (eg a conventional Ethernet 
frame switch, such as available from Plaintree, MMC) or directly with a computer; 
a rate adaption means 601 for adapting between OSI layer 2 datacoms rates and 
SDH rates equivalent to the rates of the virtual containers; and an SDH payload 
mapper 600 for mapping datacoms frames into one or more SDH payloads. Rate 
ada ption means 60 1 an d SDH pa yload ma p per 600 ma y be im plemented as a 
field programmable gate array (FPGA) or an application specific integrated circuit 
(ASIC). 

Rate adaption means 601 comprises an OSI layer 2 datacoms port, eg 
operating at 10 MBits/s or 100 MBits/s in accordance with IEEE standard 802.3; 
and a synchronous port operating at 2 MBits/s, 50 MBits/s or 100 MBits/s 
communicating with SDH payload mapper 600. Rate adaption means 601 
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comprises a through channel for adapting OSI layer 2 data frames into bitstreams 
having an appropriate data rate of 2 MBits/s, 50 MBits/s or 100 MBits/s. 

The function of the rate adaption means is to handle the frequency 
5 difference between an exact data rate at the OSI layer 2 port and an approximate 
rate achieved over a plurality N of virtual containers. 

SDH payload mapper 600 maps OSI layer 2 datacoms data frames directly 
into SDH data frames. 

10 

Further details of construction and operation of payload mapper 600 will 
now be described. 

The datacoms port card of Fig. 6 herein adapts the OSI layer 2 datacoms 
15 data frames to a data rate which matches a data rate which can be multiplexed 
into a virtual container, and maps each OSI layer 2 data frame into one or more 
SDH virtual containers directly and without any further encapsulation in 
intermediate protocols. For example, a 10 MBits/s Ethernet channel may be 
mapped onto 5 VC-12 containers, each VC-12 container having a data rate of -2 
20 MBits/s. The 5 VC-12 containers are concatenated together to carry the 10 
MBits/s Ethernet channel. For entry of a 100 MBits/s Ethernet channel into the 
synchronous network, a single 100 MBits/s Ethernet channel may be mapped 
into 2 concatenated VC-3 containers each having a capacity of -50 MBits/s. To 
carry an Ethernet 1 GBits/s channel over a synchronous network, the Ethernet 

2 5 channel may be mapped into 7 VC-4 containers, each having a capacity of -155 

MBits/s. 

A method and apparatus for directly mapping frame based data as 
described above, directly into synchronous digital virtual containers, is described 

3 0 in the applicant's co-pending US patent application reference ID 0889 filed 
contemp^an^u^ application , and entitle d "Pa yload Mapping 

in Synchronous Networks". Data frames are mapped into SDH VCs without 
encapsulation in an intermediate protocol, in a manner in which data frames 
carried within synchronous digital frames are identifiable as such, through 
3 5 provision of start and/or boundary markers delineating data frame packets 
contained within synchronous digital frames, and by other encoding schemes 
used to distinguish data frame packets from other data traffic carried within 
synchronous digital frames. Identification of frame data packets within a 
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synchronous digital frame is disclosed, maintaining a known packet transfer rate, 
and with limited and known packet size expansion. 

SDH payload mapper 600 communicates with a bitstream channel of rate 
5 adaption means 601. SDH payload mapper maps bitstream channel of rate 
adaption means 601 into a plurality of SDH virtually concatenated virtual 
containers. 

However, where a plurality of virtual containers of lower bit rates are used to 
10 carry a data frame of a higher bit rate, the higher rate data frame needs to be re- 
assembled from the plurality of lower rate virtual containers at a destination end. 

^ Referring to Fig. 7 herein, there is illustrated schematically a section of an 

U SDH network comprising first to fourth nodes 700-703. Virtual containers 704, 

CP) 15 705 sent from first node 700 and destined for third node 702 may take different 
iL" paths to each other through the network, and thereby incur a different 

transmission delay to each other, for example first container 704 may travel direct 
=P from second node 701 to third node 702, whereas second container 705 may 

travel from second node 701 via fourth node 703 to third node 702, thereby 
h.j 20 incurring the additional delay of passage through fourth node 703 compared to 
G: first container 704. 

mi This problem occurs with conventional SDH virtual containers and does not 

cause undue problem where the virtual containers are filled with data traffic from 

2 5 an appropriate telecoms tributary of an appropriate data rate, for example a 2 

MBits/s tributary in the case of a VC-12. 

However, where a plurality of associated virtual containers containing a 
single OSI layer 2 data frame are sent at substantially the same time from the first 

3 0 node, the plurality of virtual containers carrying collectively a higher data rate OSI 

layer 2 channel, the differential delay between a set of virtual containers 
transmitted substantially at the same time from the first node over the network 
becomes significant in re-assembly of the OSI layer 2 data frame. A set of virtual 
containers carrying a higher bit rate OSI layer 2 channel which are sent from the 
3 5 first node 701 simultaneously, may arrive at the destination node, third node 702 
displaced in time. 

Assuming that two virtual containers are used to accommodate an OSI 
layer 2 data rate, the two virtual containers may leave a source as two streams of 
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virtual containers 1 and 2. At the source, the Nth frame of a virtual container in 
stream 1 and the Nth frame of the virtual container in stream 2 are generated 
simultaneously. However, at the destination, the Nth frame of one stream (1 or 2) 
could arrive coincident with the N ± Xth frame of the other stream (where X is 
any arbitrary number). 

Delays occur due to transmission delays along fiber links, and delays within 
the nodes themselves. A typical delay for a 125 jus STM-1 frame at a node is 9 
bytes per STM-1 frame. This gives a lowest time delay per node of the order of 5 
p,s. Additionally, the delay incurred due to the transmission along optical fiber is 
of the order of 5 jxs per kilometer. Thus, if 2 VC-4 containers are sent across a 
network by different routes, having a round trip geographical distance difference 
of 1000 kilometers, the containers could arrive at the same destination 5 
milliseconds apart due just to the difference in fiber delay between the two routes. 
This is in addition to any delays incurred through passing through additional 
nodes, which can be of the order of up to 50-100 |is per node. A differential 
delay between source and destination over a large network of the order of 10 ms 
may be incurred. 

The above delays do not occur for all virtual containers. For example for 2 
VC-3s that run over the same physical route contained in the same VC-4, then 
the differential delay will be null (because the two VC-3s traverse the same 
route). On the other hand, where 2 VC-3s run over different routes, which could 
happen if a path protection switch only occurs on one VC, then the differential 
delay as described above may be incurred. 

The problem is addressed in the best mode implementation herein by 
virtually concatenating a plurality of virtual containers at the send transmitter. In 
this specification, by virtual concatenation it is meant that the underlying network 
is unaware of any special relationship between the virtual containers which make 
up the-group-of associated-virtual-containers— No-action-is taken at-intermediate 
nodes to suppress the differential delay between virtual containers, but rather that 
the responsibility for maintaining bit sequence integrity in the payload of a 
plurality of virtual containers is left with the terminating equipment. 

The following example relates to the case where an OS I layer 2 data frame 
at a first data rate is contained within a pair of simultaneously created VC-3s, 
each having a second, lower, data rate, the 2 VC-3s being virtually concatenated 
together and transmitted on to a synchronous network simultaneously. 
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Referring to Fig. 8 herein, there are illustrated first and second streams of 
VC-3s 800, 801 respectively which are simultaneously created at a transmit 
apparatus. Each VC-3 payload comprises 84 x 9 bytes in 125 [is, including the 
5 VC-3 path overhead bytes. The pair of VC-3 streams are created with timing to 
suit the local transmit equipment multi-frame synchronization, and may have a 
convenient pointer value. Each virtual container stream is identified by a virtual 
container stream number designated by a stream identification data comprising a 
byte in a designated position of the payload. For example, the first byte 800, 801 

10 after the VC path overhead may be used to designate the virtual container 
stream number within the plurality of virtually concatenated VCs, eg stream 
number 1 in 800 and stream number 2 in 801. Additionally, to identify the 
sequence of virtual containers within a stream further sequence identification 
data A, B are added within the VC-3 payload. Stream number data and 

15 sequence data may or may not be located in the same byte. The sequence 
identification data A, B increment before resetting and then repeating as VCs are 
generated. The number of frames over which the sequence markers A, B must 
increment before resetting and repeating is determined by the maximum 
differential delay between VCs which may be expected. The sequence markers 

20 are incremented such that if the maximum differential delay expected is 
equivalent to a time taken to generate N VC-3 frames, then the incrementation 
markers must run over at least 2N+1 frames in a stream before repeating. The 
extra 1 frame over 2N frames is to allow for the payload bytes not being uniformly 
spread over the 125 ills frame interval. 

25 

The virtual container stream numbers data indicate to which of a plurality of 
associated streams of virtual containers an individual virtual container belongs, 
whilst the sequence marker data indicates a time at which the virtual container 
was generated in relation to other previously and future generated virtual 
3 0 containers in the same stream and in associated other streams of virtual 
containers 



In the best mode described herein, the stream identification data and the 
sequence identification data (sequence markers) are incorporated in the VC 
3 5 payload section, preferably immediately after the VC overhead. However, in 
further alternative implementations, the path trace bytes present in the VC 
overhead may be used to identify a stream of virtual containers to which a 
particular virtual container belongs. The path trace byte is used conventionally to 
provide a 16 byte (or 64 byte in the case of SONET) identifier data for identifying 
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which particular circuits a virtual container belongs to, ie for example the 16 byte 
path trace overhead may be used for example by a network operator to check 
that they have correctly connected paths across a network, path trace bytes may 
be used to specify a source and destination location, a customer, and a bit rate of 
5 a path or connection. Provided each of a plurality of streams of virtual containers 
have a unique path trace byte data, then the path trace byte identification data 
may be used additionally as the stream identification data. 

Similarly, in the further implementation the sequence identification data may 
10 also be incorporated in the path overhead of the virtual containers. Options for 
incorporating sequence identification data in the VC path overhead, include using 
part of the K3 byte in the VC path overhead for sequence identification purposes. 
In the prior art, the K3 byte of the VC overhead has bits 1-4 already allocated in 
ITU-T recommendations. However, bits 5-8 of the K3 byte are user definable and 
15 in the alternative specific implementation described herein, may be used for 
carrying the sequence identification data. However, use of the K3 byte would 
enable only short sequences of virtual containers to be implemented before 
repetition of the sequence cycle occurs, due to the low number of bits available. 
Secondly, a sequence identification data pattern may be incorporated over 
20 several virtual containers by utilizing one bit or more from the payload of each 
successive virtual container of a VC stream. In an extreme case, only one bit per 
VC overhead needs to be taken to implement the sequence pattern. A pattern of 
ones and zeroes collected from successive virtual containers of a steam may be 
decoded to give the information of where in the VC stream sequence, a particular 

2 5 virtual container occurs. However, this implementation requires collection of a 

plurality of virtual containers in order to determine the start and finish of a 
sequence. By using appropriate prior art sequences, it is theoretically possible to 
cater for theoretically infinite delays between received virtual containers from 
different streams. Additionally, the scheme may be vulnerable to bit errors in the 

3 0 sequence bits. In this alternative implementation, efficiency is improved over the 
_ first imple mentation, since no payload d ata needs to be di s placed by the 

association data, however the hardware and software required for identifying 
sequences in the second implementation herein becomes more complex and a 
larger number of virtual containers need to be received before sequence 
3 5 identification can commence. 

Referring to Fig. 9 herein, there is illustrated schematically part of a transmit 
apparatus for constructing a plurality of virtually concatenated virtual containers, 
for carrying an OSI layer 2 data frame. Virtual container generator 900 
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continuously outputs a plurality of virtual containers in parallel. Virtual 
concatenator 901 adds a plurality of virtual concatenation overhead bytes 
containing the stream numbers and sequence markers just referred to. Mapping 
means 902 maps OSI layer 2 data frames to the plurality of virtual containers 
5 which are associated with each other by addition of virtual concatenation 
overhead bytes. In the example of Fig. 9, there is shown an input data stream of 
OSI layer 2 data frames at a bit rate of 100 MBits/s (eg a 100Mbits/s Ethernet 
data frame). The OSI layer 2 data frame is distributed amongst a plurality of VC- 
3s (2 in this case) 903, 904 each having a data rate of 50 MBits/s, which are 
10 launched in parallel onto a synchronous digital network. 

Incorporation of the OSI layer 2 data frame into the plurality of virtual 
containers is by byte interleaving as illustrated schematically in Fig. 10 herein. A 
first byte of the OSI layer 2 data frame is input into the payload of first VC-3, a 

15 second byte of the OSI layer 2 data frame is input into the payload of the second 
VC-3, a third byte of the data frame is input into the payload of the first VC-3, a 
fourth byte of the data frame payload is input into the payload of the second VC- 
3, and so on, so that alternate bytes of the OSI layer 2 data frame are distributed 
between the payloads of the first and second VC-3s respectively. Each VC-3 is 

20 generated with a bit rate of the order 50 MBits/s. By distributing the 100 MBits/s 
OSI layer 2 data frame between 2 VC-3s, which are associated with each other 
by virtue of the added virtual concatenation overhead bytes the 100Mbits/s OSI 
layer 2 data frame is carried directly in the payload of the VC-3s over a 
synchronous network. At the transmit apparatus, a plurality of virtually 

2 5 concatenated VC-3 payloads are effectively treated as if they were a single 

payload, into which an OSI layer 2 data frame is input. 

Referring to Fig. 11 herein, there is illustrated schematically steps in a 
method carried out by the transmit apparatus, which are carried out in real time 

3 0 and continuously as OSI layer 2 data frames are input into payloads of a plurality 

of virtually concatenated virtual containers. In step 1100, there are continuously 
generated a plurality of parallel virtual containers, which are associated together 
by means of virtual concatenation overhead bytes in step 1101. In step 1102, 
OSI layer 2 data frames are input and buffered in real time in a first in first out 
3 5 buffer. Bytes of data from the buffered OSI layer 2 data frame are byte 
interleaved into a plurality of virtual containers in parallel in step 1103. In step 
1104 a plurality of virtually concatenated virtual containers are output in parallel 
onto a synchronous digital transmission network at the same time. 
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At a destination end, the first and second VC-3s may arrive with a 
differential delay, as illustrated schematically in Fig. 12 herein. First VC-3 stream 
903 may arrive before second VC-3 stream 904 as illustrated schematically in 
Fig. 12, or alternatively first VC-3 stream 903 may arrive after second VC3 stream 
5 904 as illustrated schematically in Fig. 13 herein. In each of Figs. 12 and 13, for 
ease of illustration, a differential delay between the arrivals of first and second 
VC-3s of less than one frame (125 (is) is shown. However, in general the 
differential delay may be anything up to 10 ms as described previously. 

10 Referring to Figs. 14 to 17 herein, there is illustrated schematically a receive 

operation at a destination device, whereby a pair of VC-3 streams which have 
experienced differential delays over a transmission network arrive at the device at 
different times. Received virtual containers are fed into a memory device as they 
are recovered from their STM frames. As soon as an arriving virtual container is 

15 received the virtual concatenation overhead bytes of the VC payload are read to 
extract the stream identification data and sequence identification data which 
determine the memory location to which the VC should be written. Separate 
areas of the memory device are set aside for reception of a plurality of virtual 
containers in parallel. For example, for the receipt of 2 VC-3 containers 903, 904 

20 separate memory areas are allocated to those two virtual containers. The 
memory is divided into two for the two streams 1 and 2. Each half is then divided 
to accommodate the sequence of VC-s A to X. When the sequence repeats the 
memory is over written. For example in Fig. 14, first and second VC-3s 903, 904 
respectively are directed to first and second memory areas 1400, 1401 

2 5 respectively as soon as they are received. Since one virtual container is received 

before another, memory locations in area 1400, will be written to before memory 
locations in area 1401. 

As the virtual containers arrive, their contents are stored in the appropriate 

3 o memory areas in parallel in real time. For ease of illustration a case of two virtual 
containers which arrive within a differential delay of 125 [ is is shown in Fi g s. 14 to 

17 herein. There is illustrated schematically at different times T1-T4 how the pair 
of VC-3s are loaded into the corresponding memory areas at these times. In Fig. 
14, at time T1 the pair of VC-3s have not yet arrived, and therefore no bytes of 
3 5 these VC-3s are stored in the memory device. In Fig. 15 at time T2 the first VC 
has arrived at the destination, and the virtual concatenation of bytes of a first few 
bytes of the first VC-3 903 has been stored in first memory area 1401, beginning 
at P1. P2 indicates where the VC-3 of stream 2, frame A will be stored when it 
arrives. In Fig. 16, both first and second VC-3s are arriving at the destination end 



ID 1048 US 

-21- 

in parallel at time T2. A greater number of received payload bytes are stored in 
the first memory area 1401 for the first VC-3 than are stored in the second 
memory area 1400 for the second VC-3. The remaining portions of first VC-3 
903 and second VC-3 904 have yet to arrive at the destination equipment. In Fig. 
5 17, there is illustrated at time T4, the memory area after arrival of both the first 
and second VC-3s. Both VC-3s have been completely received and stored in 
their corresponding respective memory areas. At this time the next VC frame (B 
in the sequence) of stream 1 is being written in another memory location. 

The overall parallel process for receiving VCs operated at the destination 
apparatus is illustrated schematically in Fig. 18 herein. In step 1800, first VC 
reception begins and in step 1801, the first few bytes containing the virtual 
concatenation overhead is read. In step 1802 there are decoded the virtual 
concatenation overhead data bytes of the first received virtual container which 
associate the VCs together. A plurality of memory locations are allocated, each 
corresponding to an anticipated received virtual container of the plurality of 
associated (virtually concatenated) virtual containers. In step 1804, the arriving 
virtual containers are directed to their corresponding respective reserved memory 
areas, according to stream and sequence number read from the virtual 
concatenation overhead. 

Referring again to Figs. 14 to 17 herein, there is now described a method of 
reconstituting an OSI layer 2 data frame from the plurality of received virtually 
concatenated virtual containers. 

Referring again to Figs. 14 to 17 herein there is illustrated how an OSI layer 
2 data frame payload of first and second virtually concatenated VCs is 
reassembled upon receipt of the pair of VCs at a destination apparatus having a 
port as described in Fig 6 herein. On receipt of first incoming VC 903, a plurality 
of memory areas are reserved for the association of VCs forming the virtual 
c oncatenation of V Cs. Onc e b ytes from bo th the first and second VC s with the 
same sequence number are received, re-assembly of the OSI layer 2 data frame 
may commence. A first pointer P1 is set to a memory location of first memory 
area 1400 containing a first byte of the first VC with the sequence number to be 
3 5 processed, and similarly, a second pointer P2 is set to a second memory location 
of second memory area 1401 corresponding to a first received byte of the second 
VC with the same sequence number as illustrated schematically in Fig. 15 herein. 
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As the first and second memory areas fill up with received bytes of the 
respective first and second VCs, alternate bytes from the first and second VCs 
are read by moving the read pointer along the memory locations in parallel and 
reading alternate byte interleaved data comprising the OSI layer 2 data frame 
from the payloads of the first and second VCs. The earliest time at which reading 
can commence limited by the latest time at which the latter arriving of the first and 
second VCs with the same sequence marker begins to be stored in the memory. 

Referring to Fig. 19 herein, there are illustrated schematically process steps 
for re-assembly of an OSI layer 2 data frame from a plurality of VC payloads 
received at a destination receiving apparatus. In step 1900, the initial payload 
bytes of a first virtual container are received and in step 1901 a first pointer is set 
to a memory location corresponding to the initial bytes of the first VC payload. In 
step 1902, initial payload bytes of a second VC are received and stored in a 
second memory location. In step 1903, a second pointer is set to a memory 
location corresponding to the start of the second virtual container with the same 
sequence marker as the first. The first and second pointers are moved in parallel 
with each other in steps along successive memory locations containing 
successive payload bytes of the first and second VC payloads in step 1904, 
allowing reading of alternate bytes from the first, second, first, second, first, 
second pointers and so on, in step 1705. The OSI layer 2 data frame is 
assembled in real time as the virtual containers arrive from the interleaved bytes 
read from the memory locations of the first and second pointers P1, P2 in step 
1906. 

In a best mode implementation for performing the read operation, each 
memory area allocated to a virtual container stream is preferably large enough to 
contain enough bytes corresponding to twice the maximum anticipated differential 
delay between arrival of two virtual containers. Although this implementation is 
inefficient of memory usage, in that only enough memory to accommodate the 
.different^ 



Referring to Fig. 20 herein, there is illustrated schematically components of 
an OSI layer 2 port for recovering a stream of OSI layer 2 data frames 2000, 
2001 from a plurality of streams of incoming virtual containers 2003. The 
components comprise a random access memory 2004 divisible into a plurality of 
memory areas, each containing a payload of an incoming virtual container; a 
data processor means configured for operating as a virtual container virtual 
concatenation overhead byte analyser 2005 for reading virtual concatenation 



ID 1048 US 

-23- 

overhead bytes of the plurality of virtual containers and determining from those 
bytes the memory locations in which the pay load data is stored, and a read point 
generator 2007, receiving inputs from the virtual concatenation overhead byte 
analyser operating to generate read pointers for the appropriate memory location 
5 to be read. The read pointer generator 2007 generates a plurality of read 
pointers which each address a specific identified memory location within each 
memory area, the memory locations to which the read pointers are set being 
selected such that reading those pointed to memory locations in sequence 
recovers the OSI layer 2 data frame sequentially. A plurality of memory areas 
10 have their individual memory locations read contiguously so as to recover the 
OSI layer 2 data frames from the plurality of virtual containers which may be 
received at the OSI layer 2 port non-contiguously, having a differential delay 
there between. 

15 




